Solving Optimization Problems with Blackwell Approachability

نویسندگان

چکیده

In this paper, we propose a new algorithm for solving convex-concave saddle-point problems using regret minimization in the repeated game framework. To do so, introduce Conic Blackwell Algorithm + ([Formula: see text]), parameter- and scale-free minimizer general convex compact sets. [Formula: text] is based on approachability attains regret. We show how to efficiently instantiate many decision sets of interest, including simplex, norm balls, ellipsoidal confidence regions simplex. Based text], parameter-free achieving ergodic convergence rate. our simulations, demonstrate wide applicability several standard from optimization operations research literature, matrix games, extensive-form distributionally robust logistic regression, Markov processes. each setting, achieves state-of-the-art numerical performance outperforms classical methods, without need any choice step sizes or other algorithmic parameters. Funding: J. Grand-Clément supported by Agence Nationale de la Recherche [Grant 11-LABX-0047] Hi! Paris. C. Kroer Office Naval Research N00014-22-1-2530] National Science Foundation IIS-2147361].

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Blackwell Approachability and Minimax Theory

This manuscript investigates the relationship between Blackwell Approachability, a stochastic vector-valued repeated game, and minimax theory, a single-play scalar-valued scenario. First, it is established in a general setting — one not permitting invocation of minimax theory — that Blackwell’s Approachability Theorem (Blackwell [1]) and its generalization due to Hou [6] are still valid. Second...

متن کامل

Online Learning and Blackwell Approachability in Quitting Games

We consider the sequential decision problem known as regret minimization, or more precisely its generalization to the vectorial or multi-criteria setup called Blackwell approachability. We assume that Nature, the decision maker, or both, might have some quitting (or terminating) actions so that the stream of payoffs is constant whenever they are chosen. We call those environments “quitting game...

متن کامل

Blackwell Approachability and Low-Regret Learning are Equivalent

We consider the celebrated Blackwell Approachability Theorem for two-player games with vector payoffs. We show that Blackwell’s result is equivalent, via efficient reductions, to the existence of “noregret” algorithms for Online Linear Optimization. Indeed, we show that any algorithm for one such problem can be efficiently converted into an algorithm for the other. We provide a useful applicati...

متن کامل

Blackwell Approachability and No-Regret Learning are Equivalent

We consider the celebrated Blackwell Approachability Theorem for two-player games with vector payoffs. Blackwell himself previously showed that the theorem implies the existence of a “noregret” algorithm for a simple online learning problem. We show that this relationship is in fact much stronger, that Blackwell’s result is equivalent to, in a very strong sense, the problem of regret minimizati...

متن کامل

Solving Optimization Problems with DLL

Propositional satisfiability (SAT) is a success story in Computer Science and Artificial Intelligence: SAT solvers are currently used to solve problems in many different application domains, including planning and formal verification. The main reason for this success is that modern SAT solvers can successfully deal with problems having millions of variables. All these solvers are based on the D...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Mathematics of Operations Research

سال: 2023

ISSN: ['0364-765X', '1526-5471']

DOI: https://doi.org/10.1287/moor.2023.1376